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Abstract 

We study in this paper the effect of an unique initial stimulation on random recurrent 
networks of leaky integrate and fire neurons. Indeed given a stochastic connectivity this so- 
called spontaneous mode exhibits various non trivial dynamics. This study brings forward a 
mathematical formalism that allows us to examine the variability of the afterward dynamics 
according to the parameters of the weight distribution. Provided independence hypothesis 
(e.g. in the case of very large networks) we are able to compute the average number of 
neurons that fire at a given time - the spiking activity. In accordance with numerical 
simulations, we prove that this spiking activity reaches a steady-state, we characterize this 



steady-state and explore the transients. 

1 Introduction 

Many modern neurobiological problems have to confront the behaviors of large recurrent 
spiking neuron networks. Indeed, it is assumed that these observable behaviors are a result 
of a collective dynamics of interacting neurons. So the question that rises becomes : given 
a connectivity of the network and a single neuron property, what are the possible kinds of 
dynamics ? 

In the case of homogeneous nets (same connectivity inside the network) , some authors 
found sufficient conditions for phase synchronization (locking) or stability (Chow, 1998; 
Gerstner, 2001). Another author (Coombes, 1999) calculated Lyapunov exponents in a 
given symmetric connectivity map and showed that some neurons were "chaotic" (i.e. the 
highest exponent was positive). In the very general case (Golomb, 1994; Vreeswijk & 
Sompolinsky, 1996; Meyer & Vreeswijk, 2002) it has been shown that the dynamics can 
show a broad variety of aspects. 

In the particular case of integrate and fire neurons, (Amit & Brunei, 1997a, 1997b) used 
consistency techniques on nets of irregular firing neurons. This technique allowed them to 
derive a self-sustaining criterion. Using Fokker-Planck diffusion, the same kind of methods 
was used in the case of linear I&F neurons in (Fusi & Mattia, 1999; Mattia & Giudice, 
2000), for stochastic networks dynamics with noisy input current (Giudice Sz Mattia, 2003) 
and in the case of sparse weight connectivity (Brunei, 2000). 

However, stochastic recurrent spiking neurons networks are rarely studied in their spon- 
taneous functioning. Indeed most the time the dynamics is driven by an external current 



- whether meaningful or noisy. Nevertheless, without this external current, the resulting 
dynamics is often conjectured. Our experimental results showed that large random recur- 
rent networks exhibit interesting functioning modes. Depending on a coupling parameter 
between neurons (e.g. the variance of the distribution of weights) the network is able 
to follow a wide spectrum of spontaneous behavior - from the neural death (the initial 
stimulation is not enough to produce any further spiking activity) to the limit of maximal 
locking (some neurons fire all the time and the others never). In the intermediate states 
the average spiking activity grows. However we found out that the average spiking activity 
reaches a steady-state. 

Thus, following basically the same ideas as (Amit & Brunei, 1997a; Fusi & Mattia, 
1999), we try to predict these behaviors when using large random networks. In this case, 
we make an independence hypothesis and use mean field techniques - note that this so- 
called mean field hypothesis has been rigorously proved in a different neuronal network 
model (Moynot & Samuelides, 2002). More precisely, in our case, the connectivity weights 
will follow an independent identically distributed law and the neurons firing activities are 
supposed independent. 

After introducing the spiking neural model, we propose a mathematical formalism which 
allows us to determine (with some approximations) the probability law of the spiking activ- 
ity. Since no other hypothesis than independence are used, a reinjection of the dynamics is 
needed. It leads expectedly to a massive use of recursive equations. However non intuitive, 
these equations are a solid ground upon which many conclusions can rigorously be drawn. 

Fortunately, the solutions of these equations are as expected (and often taken for 
granted), that is the average spiking activity (and as a consequence the average frequency) 
reaches a steady state very quickly. Moreover, this steady state depends only on the pa- 



rameters of the weight distribution. To keep the arguments simple, we detail the process 
for a weight matrix following a centered normal law. Extensions are proposed afterward for 
a non-zero mean and a sparse connectivity. All these results corroborate accurately with 
simulated neural networks data. 

2 The neural model 

The following series of equations describe the discrete leaky integrate and fire (I&F) model 
we use throughout this paper (Tuckwell, 1988). Our network consists of N all-to-all coupled 
neurons. Each time a given neuron fires, a synaptic pulse is transmitted to all the other 
neurons. This firing occurs whenever the neuron potential V crosses a threshold 6 from 
below. Just after the firing occurred, the potential of the neuron is reset to 0. Between a 
reset and a spike, the dynamics of the potential is given by the following (discrete) temporal 
equation : 

N 

Vi{t) = jV^t - 1) + h{t) + Y, W iA* ~ T J ~ d ij) (2" 1 ) 

i=i 

The first part of the right hand side of the equation describes the leak currents (0 < 
7 < 1 7 is the leak). Obviously, a value of for 7 indicates that the neuron has no short 
term memory. On the other hand, 7=1 describes a linear integrator. 

The Wij are the synaptic influences (weights) and Ii is an external input. S(t) = 1 
whenever t = and otherwise (Kronecker symbol). The Tj are the times of firing of a 
neuron j. dij is an axonal delay and (as well as Tj) is a multiple of the sample discretization 
time. The times of firing are defined formally for all neurons i as : 



lim VATi -At) = 9 
At->o- 



(2-2) 



and so we define TJ 1 (the date of the n-th firing date) recursively as follow : 



7f = inf(t \ t>T?-\V i {t)>O i ) 



(2-3) 



We set that Tf = -co. Moreover, once it has fired, the neuron's potential is reset to zero. 



Vn,Vz, lim F;(7f + At) = 



(2-4) 



In this discrete description of an I&F neuron, equations (2-2) and (2-4) can be dis- 
turbing. They only mean that when computing Vi(T™ + 1) we set Vi(T™) = in equation 



In our study, we examine only spontaneous activity. It means that except at t = 
there is no external input : V i, V t > 0, ij(t) = 0. Moreover, given the above description, 
it is possible to allow great heterogeneity for various parameters. In order to simplify, 
we restrict ourselves in this paper to a synaptic weight heterogeneity leaving the other 
parameters constant. So V i, V j, dij = (the axonal delay is 0). Similarly, V i, 0{ = 9 
(same threshold for all neurons). Finally, suppose that the weights follow a centered normal 
law N(0, a 2 ) and let cp = a\HV. 



(2-1). 



3 General Study 



In this section we give a very general formulation of the distribution of the spiking activity 
defined as X t the numbers of firing neurons at a time step t for an event. We partition X t 



according to the instantaneous period of the neurons. That is we write 



x t = + ... + xt 1] 

when x\ k ^ is the number of neurons who have fired at t and t — k but not in between. 
Suppose that all neurons had a potential at the starting process and only Xq neurons 
were excited in order to make them fire, so V^(l) = J2f=i Wy- Thus using equation (2-3) 
we have: 

N 

x i = 5Z*{Vi(i)>«} 
1=1 

where X{Vi(i)>e} = 1 whenever Vi(l) > 6 and otherwise. Keeping on we have : 

x 1 N 

x 2 = J2x{v l (2)>e} + J2x{v l (i)<e,v l (2)>e} 
i=i i=i 

Indeed, the number of firing neurons at time step 2 are those that have fired twice (at t = 1 

fll X" 

and i = 2 that is X^ = Yli=i X{Vi(2)>e} since the reset potential is 0). We need to add 
those that have not fired at t = 1 (X^ = J2iLi X{Vi(i)<e,v t (2)>e})- 

Thus for t, taking into account the initial step, we have recursively : 

t (Xt-u \ 

x t = J2\ X{v i (t-v)<e,...,v i (t-i)<0,Vi(t)>0} ( 3 ' 5 ) 

u=l \ i=l J 

where Xk = Xk for k / and Xo = N. 

Now assume that neurons dynamics are independent, we can calculate the expectation 



of X t (by the so-called first Wald's identity) 



t-i 

E(X t ) = Y,nXk)P(k,t) (3-6) 

k=0 

setting P(k,t) = E (x{V5(fc+i)<9,.. ) v i (t-i)<tf,V i (t)>e}l V i( fc ) = °)- 

The P(k, t) are the expectation of a Bernoulli distribution. It leads that : 

Vax(x{v i (fc+i)<tf ) ... ) v i (t-i)<tf,v i (t)>tf}) = f(M)(l - f(M))- 

We are now able to retrieve the variance of Xt (second Wald's identity) : 

t-i 

VarpQ) = Y, (HX k )P(k,t)(l - P(k,t)) + Var(X fe )P(M) 2 ) (3-7) 

k=0 

More generally the moment generating function can be recursively computed : 

t-i 

Gx t (s) = U G x k ( p ( fc ' t)s + l- P(k, t)) (3-8) 

k=0 

4 Average Number Calculation 

The equations (3-6) to (3-8) are useful when we can estimate the P(k, t) coefficients. We 
recall that P(k,t) = E (x{y,(fe+i)<e,...,y l (t-i)<e,y l (t)>e}l^(^) = 0). Thus the potential is a 
random sum of independent identically distributed normal laws (the weights). Unfortu- 
nately, this random sum is not, in general, a normal law itself. Nevertheless, as it is proved 
in appendix A, (see equation A-28), when the number N of neurons is large enough, and 
for a general class of distributions of the random variable X t , we can write, for a neuron 



that has its potential Vi(t) = : 

i r°° 2 

Vi(t+1) ~ JV (0,E(X t )a 2 ) =>P(Vi(t + l) >0) = -= / e^efe (4-9) 

V27T / 9 

From now on we suppose that 7 / 0. We need to know which are the neurons that 
have their potential V£(t) = 0. When all neurons receive a charge from a non-zero number 
of neurons, the probability to have the potential equal to zero vanishes. Thus only the 
neurons that fired at time t have this property (except for t = when it is true for all 
the neurons). But taking into account a non-zero leak, we need to make here another 
independence assumption concerning the previous charges. Indeed the charge received by 
a neuron between t and t + k comes from ^ k X t + . . . + jXt+k-i + -Xt+fc "neurons". But in 
order to proceed further we assume that theses charges are independent. Note that when 
7 is equal to zero this extra hypothesis is not needed. It leads to : 



t-fc-i 



p(k,t)= n 



m=l 



f l(k,m) 

£ 



1-P £ > 



'l(k,t-k) 

P\ ]T W„>0] (4-10) 



where we set 

m+k— 1 

|(jfe, m ) = 7 m - fc - i - 1 E(X i ). 
j=fe 

In order to lighten notations, we put x t = E ffi^ , and : 



We recall that we set (j) = aVN. So equation (4-10) becomes : 



(t-i \ t-i 

E^ -1 ^) n 
i=k / m=k+l 



tm—\ 



, i=fc 



(4-11) 



Using the same notation we get the recursive computations of E(X t ): 



t ft \ t 

= e £fep * ( e 7 *~ ixi ) n 

fc=0 \i=fc / m=k+l 



/ m—l 



. j=fe 



(4-12) 



where V/c > 0, x& = and xo = 1- 

Moreover, we can compute the P(k,t) recursively. Indeed, let = Y^i=kl t ~ % x i * nen 
u\ +l = t lit + x t- Moreover : 



P{k,t + l)= P4> {u k t ) fj (l-p ( t 4_ 1 ))=p ( u *)(_J_-l)P(fc,i) (4-13) 

m=fe+l PA U t-l) 



with P(i, f + 1) = P(j,{xt) and = x<. P(fe, t) = whenever t < k. 

Equations (4-12) and (4-13) are our main result. We can see that there is no more 
reference of the number of neurons. However, the algorithm grows exponentially with the 
time. 

Recalling a more classical spiking neurons formalism, we remark that equation (3-6) 
can be viewed as an integral over past charges of the form : 



x(t) = / x(i)P(i, t)di 



(4-14) 



This is exactly Gerstner's formula (Gerstner, 2001) to compute spiking activity defined 



(using our notations) as : 



1 N 
x t = lim YY5(t-T?) 

n>0 i=0 



In the case 7 = we can deduce the result independently from the above equations. 
Indeed, since it means that at each time step the potential is reset to zero, we can directly 
write the probability of spiking of one neuron according to the number of neurons that 
have previously fired. Thus, with the same notations and hypothesis : 

x t =p<t > (x t -i) (4-15) 

But it is a special case of equation (4-12) when 7^0. See appendix B for a detailed proof. 

5 Analysis 

The equation (4-12) is difficult to estimate. However some important things can be claimed. 
Following from the definition of the P(k, t) we have for large enough t : 

t 

£P(fc,t) = l (5-16) 

k=0 

It leads that xt is bounded and for large enough t monotonic. Therefore, xt converges 
towards x* when t — ► 00. x* = (neural death) is an obvious solution. For high enough <f> 
another fixed point exists bounded by 1/2. Moreover, in this case, the P(k,t) are close to 
a geometric distribution of parameter p^x*). Due to the definition of P(k,t), it leads to a 



geometric distribution of Inter-Spike Intervals that is 



P(ISI = u)= P(t - u, t) (5-17) 

It enables us to define a network frequency /* denned as : 

f* = (E(ISI)r 1 = (E(u))- 1 = P^(x*) (5-18) 

But if we define the network average frequency F(t) of a network over a period T and at 
a given time t by : 

N T 

i^) = ^£^i>(i-fc) (5-19) 

i=l fe=o 

where 5i(t) = 1 if the neuron % has fired at time t and <5j(i) = otherwise (in other words 
5i(t) = Yln>o ~~ ^T))- Switching the sum symbol gives : 

T N T 

= ^ E ^ E *(* - *) = ^ E ( 5 - 2 °) 

fc=0 i=l fe=0 
for this realization of the distribution. Taking the expectation leads to : 

1 T 

/(t)=E(F(t)) = -J> t _ fc (5-21) 

k=0 

It means that the average frequency (on a time window T) is the average of the spiking 
activity (over a period T). Thus, when t — ► oo it leads to : 



/(*) = * 



(5-22) 



Due to discrete timing, we generally don't have /* = /. Instead we have /* < /. It gives 



P^x*) < x* (5-23) 
The inequality becomes an equality if 7 = 0. This is the case we now study. 

5.1 Simple case 

If we consider the case 7 = 0, we recall that xt = p^xt-i). So x* = p^x*). 

A solution x* / exists when p<j,{x) crosses the line y = x and is stable if and only if 
p'<f)( x *) < 1 (here p'^ is positive on all the positive line). If it exists x such that p<j>{x) > x 
then p<j,(x) = x has only two solutions. The first (lowest) one is an unstable fixed point 
and the other is a stable fixed point. So if xq is above the lowest fixed point, the average 
number of neurons converges toward x*. In the other case, it converges to (i.e neural 
death). We can derive a sufficient condition for the convergence to zero (see appendix C 
for details) : 

3 

<f> < (^j 4 vr3# « 2.086< (5-24) 

5.2 Previous charges independence 

In the case 7 / 0, we now need the independence of charges hypothesis. However in the 
general case, we allowed the potential to have strong negative values. More than to be 
biologically wrong, it dramatically impedes the independence hypothesis. Indeed, some 
neurons with very low potential will never fire whatever happens. 

In order to take this into account, we make a (biologically plausible) assumption : the 
potential is not allowed to decrease under a minimal value v m i n . This leads us to reconsider 



the charge function : 



P(k,t) = ^{x{v i (t-k+i)<e,...,v i (t-i)<e,v i (t)>e}) 



We recall that under the hypothesis of independence and since we have a normal law 
for the weights it leads to : 



where p<f> is the new probability function we need to compute. 

Let's assume that a neuron i has taken a charge C in the previous times and is subject 
to a charge x t at time t. The probability that the total charge exceeds the threshold must 
be split in two cases : the potential occurred by C is below v m i n or not. In the first case 
(below v m in), the charge will be xt on a potential D mm with probability p = P($ < D mm ), 
where $ ~ N(0,Ca 2 ). In the other case it will be C + xt (with probability 1 — p). So the 
resulting probability will be : 



P{Vi{t) > 9) = P($ > 0) where $ ~ ( P N(v mm , x t a 2 ) + (1 - p)iV(0, (C + x t )a 2 )) 
= P($ > 6) where $ ~ N{pv min , ((1 - p)C + x t )a 2 ), 



We can find the P(k,t) recursively noting that the probability p depends on previous x t . 
To simplify, we suppose that v m i n = (i.e the neuron cannot have negative values) it is 
even simpler. In this case, whatever the charge is, the probability p is always 1/2. So 




(5-25) 



equation (5-26) becomes 



P(Vi(t) >0) = P($ ~ N(0, (| + x t )a 2 ), <S>>6) (5-26) 
It acts as if the decay rate was divided by two. Thus into equation (4-12) it leads to : 

t t—m . t—m—1 j 

Xt+1 = ^ XrnP<p(Yl (|) X t~i) II ( J (^} kx i~k+m)) (5-27) 

m=0 i=0 j=0 k=0 

where Vm > 0, x m = x m and xo = 1. 

6 Results and comparison 

We conducted extensive numerical simulations to confront our formulas. The results we 
present here were made with 500 random networks of 1000 I&F neurons. The starting stim- 
ulated neurons were chosen randomly for each network tested - each neuron was scanned 
and set to fire with a probability xq. xq was chosen between 0.05, 0.30, 0.5, 0.8 and 1.0. 
To be in concordance with equation (5-27) we set v m in = 0. 

6.1 Asymptotic Spiking Activity Comparison 

We recorded the limit of x t according to different values of 4> and for 7 = 0. 0, 0.5, 1.0. The 
results of the theoretical and experimental simulations are displayed in figure 1. The limit of 
%t is an increasing function of <fi. Moreover lim^ +oc (lim^ +00 x t ) = 1/2. As easily seen, 
the higher (p and lower 7 give an extremely good prediction compared to experimental 
data. A high 7 always gives a slight overestimation in the case of high <fi. Indeed, the 
independence of charge never holds. On the other hand, when this hypothesis is rigorously 



true (i.e 7 = 0) the prediction is strikingly accurate. For small values of 0, the prediction 
was correct also. However it exists an interval of intermediate values of (f> (that is here 
between 1.5 and 2.0) where the prediction completely fails. Besides we shall see in the 
next section that this is also the case for the transient period. Indeed, for small enough 
coupling, the independence of the dynamics of neurons is not true. We expect that the 
length of this interval tends towards zero when N grows infinitely. 

6.2 Transient period 

We recorded the evolution of the spiking activity for the transient period before reaching 
the asymptotic limit for various values of 4> and 7 during the first 50 time steps. The results 
are displayed on figure 2. As in the previous section, a higher 7 gives a slight overestimation 
but is completely correct when 7 draws near zero. Moreover, we retrieve the same interval 
of (f) where the neurons dynamics independence fails (and as a consequence the transient). 
These results show that the steady-state is reached very quickly (less than 10 time steps). 

7 Generalization 

We supposed to make the arguments clear that the weight distribution followed a very 
simple law - a centered normal law. However, we do not have to restrict ourselves to this 
limit. Indeed, we look at two possible extensions of spiking activity equations. We show 
that it is possible to use a non-zero mean for the distribution as well as a sparse weight 
matrix in a certain sense. The results obtained showed the same characteristics. 



7.1 Non-zero mean 

In fact taking a non-zero mean is very easy. Indeed, provided that all the hypotheses 
remain valid, we can insert the mean into the definition of which becomes p^^ defined 
as : 



which corresponds to a normal weight distribution N(j!j, -j^)- In order to relate this to 
a very simple case, we can look at what happens when cp ^ - that is an homogeneous 
network. It leads to p^^iy) = when \xy < 9, p^^y) = 1 when fiy > 9 and finally 
P<j>,n(y) = 1/2 when fj,y = 9 . All depends on the value 

Case £fa < 1 In this case, x\ — Pfanfao) — and it converges to neural death that is 
V t>0x t = . 

Case ^ > 1 Here, x\ = p^^xq) = 1 leads to V t > Xt = 1. All neurons fire at the same 
time and with the highest frequency (one spike per time step). 

Case ^ = 1 Now, x\ = p</, i(U (xo) = 1/2. Suppose xq < 1/2 then p<j>^(xi) = 1 leading 
X2 = xip^ixi) + p^ijxo +xi)(l -p<i>,n{xo)) = 1/2x1 + 1x1/2 = 1 leading to the case 
^ > 1. On the other hand if x > 1/2 then p p hi^{x\) = leading to case ^ < 1. It 
left us with xq = x\ = 1/2. In this case, X2 = 1/2 as for all other xt- This result can be 
strange if we forget that <p <C 1 but <j> /= (if not the weight independence is no longer 
true) leading an average value between the two first cases (hence xt = 1/2). 
The general behavior does not change with non-zero mean. The convergence is very fast 
and the transient are well predicted as shown in figure 3. The only difference with \x > 
is that x* can be well above 1/2 and ultimately reach 1. 




7.2 Sparse connectivity 

A pure normal distribution is unlikely to occur in biological neurons. Most of the time, 
neurons are linked to a certain amount of neurons in the network. It can be viewed using 
a sparse weight matrix (a matrix with zero coefficient). In order to take this into account 
we compute sparse matrix as follows. A weight w has a probability p to be zero and a 
probability 1— p to follow a normal law N(fi/N, <p/y/N). As in the previous section it leads 
to a new function. When calculating the charge, it came from "A" neurons leading to 
a sum of X normal laws. In the case of sparse matrix, it reduce to (1 — p)X neurons. So 
our new function becomes: 

It remains to insert this new function into equation (5-27). As shown in figure 4, the general 
behavior is not changed when introducing sparsity. 

8 Discussion 

Independence hypothesis can be a very powerful way to approach random networks of 
spiking neurons. So far, we proved that the "coupling factor" ((f) = ay/N) can characterize 
the average spiking activity. For instance whatever the initial stimulation (provided it 
is strong enough and independent of the neurons), the networks average spiking activity 
reaches the same steady-state. Since the death locking is also a possible steady-state, in 
dynamical systems terminology, depending on the value of </>, we exhibited a bifurcation. 
In addition, this steady-state only depends on the coupling parameter (for a fixed type 



of neurons i.e. same leak). This dependence (if not obvious) is increasing and converges to 
1/2 when <p grows larger. That is a limit state where half the neurons that are active fire 
all the time and the remaining stay silent. That is an extreme locking. Indeed, all neurons 
are periodic (either 1 or oo) and those that fire do it synchronously (that is all the time). 

The transient phase was also well determined - very quick convergence to the steady- 
state. We were also able to derive mathematically a sufficient condition for death locking 
(in a very simple case though). 

However, as showed for a certain range of coupling factor, independence is deemed 
to fail and consequently the prediction - both in transient and asymptotically. Indeed, 
intuitively when a coupling value is intermediate, neurons can no longer behave as if it did 
not matter who fired. It seems somehow that this range of "failed independence" grows 
thin with increasing N (at the thermodynamical limit). 

This shows that a spontaneous regime can be self-sufficient. It means that networks 
can afford discontinuous inputs without losing their internal activity. In other words, it is 
theoretically possible to observe dynamic cerebral areas without any permanent external 
stimulation. 
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A Random sum of random variables 

Let us first prove a general result, which will have an application for the neuronal potential, 
written as a random sum of i.i.d. random variables. 

Let / be a function so that lim^ 0O /(A;) = a G R, (jPk)(k,N)eN 2 a sequence satisfying 
Vfc G N, lim^oopf = and Y$=iPk = L Let now define 9(*0 = Ek=iPk f( k )> and 
prove that 

lim g(N) = a. (A-28) 
Ve > 0, 3N £ N, Vfc > 7V , - a| < f . So we can write 



| 5 (iV) - a| < 



iV 

XX(/(*)-aC 
fc=i 



+ 



AT 



< 



fc=i 



+ 



A being fixed, it just remains, to complete the proof, to get a rank Ni so that 



VA > iVi, 



No 

fc=l 



ft, 



e 

<2- 



Application : let X^ be a sequence of random variables on [1,N] so that 



lim E(A (A °) = oo and Vfc, lim P{X (N) = k) = 0, 



which is satisfied for instance when X( N ^ ~ N(^.,a 2 ) or when A"^) is uniform on [1, A]. 
In this case, if we set = ¥(X^ = k) we can write g{N) = E(/(A^ Ar ))), and equation 
(A-28) yields 

lim E(/(lC') - f(E(X^)) = 0. (A-29) 

A"^oo 



Equation 4-9 derives from the case 



1 f+°° 

f(k) = —= / e 2 dx. 



B Simple Case 

We prove here that substituting 7 = in equation (4-12) give the equation : 



x t =p< j> {x t -i 



It yields : 

t t-i 
xt+i = ^2 £ rnP<p(x t ) Y[ (1 -P<f>{xj)) 

m=0 j=m 



For t = 0, it gives xi = p<f,(xo). Using the recurrence hypothesis Vwi — 1 . . . t, x r 
x m -i) we find that : 



t-i 



xt+i = ^2P(/>(x m -i)P4>(xt)Y{(. 1 ~P<t>( x 3)) 

m=0 j=rre 
t t-1 

m=0 j=m 

= P<f>{xt)v t -i 



Is is now enough to note that 

t-i t-2 

Vt-l = P<t>{ x t~l) + (1 - P4>{x t -i)) ^ p^Xrn-i) Y{ (1 - TtyO^))) 

= p^Xt-l) + (1 - p^,(x t _i))v t _2 



Since t>o = (1 — p</>(xo)) + P<f,(xo) = 1, we have = 1 for all i. We showed by recurrence 
that we get equation (4-15). 

C Sufficient condition for death 

Let's go back to 



1 f 00 



for y £ [0,1]. Taking the derivative over y we have : 



We see immediately that p'^{y) > so p^ is increasing. So, stable non-zero fixed points 
should appear for a value of y that crosses the line y = x from above. Then a sufficient 
condition is that Vy : 



Let 2 = i, r = ^ and = then : 



Taking the derivative of g(z) yields 



U \ Tzl/2 -r 2 z f 3 2 A 

9{Z) = 2^ e \2- TZ ) 

So g'(z) has the same sign as — z and since g'(0) = g f (+oo) = 0, it leads that the 
maximum of g(z) is obtain for z = But z = | thus z € [1, +oo[. It leads that 

max^G/) = m ax ,9i z ) = max (5 ( 7r~2 ) .fl'W ) 
j/e[o,i] v «e[i,+oo[ V V 2r / / 

So a sufficient condition for zero to be the only fixed point becomes : 
Since r = we get : 

4>< (y) 4?r ^ 
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Figure 3: Transient with different mean \x for <p G {1.0,2.0,5.0,7.0,8.0}. Theoretical re- 
sults are disnlaved with a, nlain line, while exnerimental data, noints are circles. Parame- 



p = D.2 



p = 0.4 




Figure 4: Transient with different sparse parameter p (we recall that p = means a zero ma- 
trix while r> = 1 is a, nure normal distribution") for cb F 13.0.4.0.5.0.6.0.7.01. Theoretical 
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